NASA Technical Memorandum 108979 

j 66 6V7 

fill 


NASA Scientific and Technical 

Program - User Survey 


J.F. Hunter and C.W. Shockley 


(NASA-TM-108979) NASA SCIENTIFIC 
AND TECHNICAL PROGRAM: USER SURVEY 
(NASA) 11 p 


N93-19937 


Unc las 


63/82 0150547 





SI 

DIE 

NTI 

FIC & 

T 

EC 

HN 

CAL 

IN 

FO 

FtMATION 



NASA SCIENTIFIC AND TECHNICAL PROGRAM — USER SURVEY 


Judy F. Hunter 

Scientific and Technical Information Program 
NASA Headquarters 
Washington, DC 

Cynthia W. Shockley 
Logistics Management Institute 
Bethesda, Maryland 


Abstract 

An intensive user requirements survey 
was undertaken by NASA's Scientific and Techni- 
cal (STI) Program to improve the foundation for 
its user outreach program and in response to the 
STI Council. For this investigation, the definition 
of STI encompasses textual, graphic, numeric, 
image, audio, or video information produced do- 
mestically and internationally. Between January 
and April 1992, 550 NASA scientists, engineers, 
and contractors were personally interviewed. 
Another 650 individuals responded to a mailed 
out questionnaire. User requirements data were 
collected on use of NASA's STI publications assis- 
tance program for producing STI, as well as ac- 
cess to STI through the use of people, printed, 
and electronic resources, both internal and exter- 
nal to the NASA STI Program. To analyze the 
user demographics data, a database was built, 
used for analysis, and will be used for ongoing 
analysis by the NASA STI Program. 

I. What is NASA's Scientific and Technical In- 
formation Program? 

As defined by the Scientific and Technical 
Information Program of NASA Headquarters, 
scientific and technical information (STI) is the 
collected set of facts resulting from scientific, 
technical, and related engineering research and 
development efforts. It includes information from 
both basic and applied research in the entire 
range of scientific disciplines. STI encompasses 
text, numeric data, graphics, images, audio, and 
video information. It is obtained from experi- 
ments, observations, instruments, or computers. 
STI is produced domestically and internationally. 

The NASA STI Program was established 
to provide STI management and services as a part 


of the agency's mission as stated in the National 
Aeronautics and Space Act of 1958 (P.L. 85-568). 
That Act charged NASA with die responsibility to 
"provide for the widest practicable and appropri- 
ate dissemination of information concerning its 
activities and the results thereof." Since that time 
the STI Program has grown to address three ma- 
jor areas: 

• STI Program Products which include 
announcement publications, current awareness 
products, STI handbooks and tools, NASA techni- 
cal report series, and continuing and special bibli- 
ographies. Representative publications are STAR 
( Scientific and Technical Aerospace Reports) and 
SCAN ( Selected Current Aerospace Notices). 

• STI Program Services which include 
reference and literature services, training, transla- 
tions, online assistance, microfiche and hardcopy 
document supply services, document distribution 
subscription services, and current awareness ser- 
vices. 

• STI Publications Assistance which sup- 
ports researchers in publishing their work by pro- 
viding for all aspects of the production process 
including editing, graphics, reproduction, and 
printing. 

The core system for these products and 
services is RECON (Research Connection) — the 
large-scale, online information retrieval database. 
This system, begun in 1968, is now used for over 
75,000 searches annually, is accessible from termi- 
nals worldwide, and contains over three million 
bibliographic citations. RECON is operated on a 
day-to-day basis by the Center for AeroSpace In- 
formation (CASI). Here new STI arrives in all me- 
dia from a variety of sources, is reviewed and 


analyzed, and incorporated into RECON. CASI 
also films all NASA-supported reports to produce 
microfiche copies for distribution. There are also 
several STI Program services available, such as 
technical translation services and customized bib- 
liographies. 

The NASA STI Program maintains opera- 
tions at Headquarters and each of the 10 NASA 
Centers. Each Center is responsible for ensuring 
that reports from NASA employees and contrac- 
tors are introduced into the STI system- The Cen- 
ters provide NASA employees with publishing 
support, technical library services, and multime- 
dia presentations. Center STI staff employ all 
available products and services to serve their us- 
ers. Center libraries contribute to the Aerospace 
Research Information Network (ARIN) database 
which is the union list of NASA library holdings. 
ARIN also serves as the integrated library system 
supporting other functional areas; such as, shared 
cataloging, bibliographic searching^ circulation, 
interlibrary loan, and management information. 

Thus, the STI Program provides users ac- 
cess to a massive flow of STI which represents the 
largest collection of aeronautical and space sci- 
ence information in the world. The STI Program’s 
goal is to provide relevant and timely STI prod- 
ucts and services for its users — NASA scientists, 
engineers, managers, and NASA contractors, oth- 
er government agencies and their contractors, 
universities throughout the world, international 
partners, and the general public. 

IL- Kev Issue: What Role is the NASA STI 
Program Playing? 

In the winter of 1990, the STI Program of 
NASA Headquarters directed that a study be un- 
dertaken to update their understanding of users' 
requirements for its products and services. In 
April 1991, the NASA STI Council, chaired by Dr. 
Leonard A. Harris, was formed as an internal 
committee to provide impartial advice and coun- 
sel on the STI Program. Membership of the Coun- 
cil is provided representatively by individuals 
from Headquarters, a Research Center, a Flight 
Center, and Goddard Space Flight Center or the 
Jet Propulsion Lab (JPL). The Council is com- 
posed of senior NASA employees who are able to 
speak authoritatively and have a broad under- 


standing of NASA's STI needs and concerns, and 
those of the aerospace community at large. 

The Council began reviewing overall STI 
issues. The major issues were to understand bet- 
ter the STI user community, determine user re- 
quirements, and identify improvements for 
products and services provided by the STI Pro- 
gram. The original study directed by the STI Pro- 
gram was refocussed to address the following 
questions raised by the Council: 

• Who are the STI Program users? 

• What are the products and services 
used across the NASA Centers? 

• Who are the frequent users and why? 

• Who are the infrequent or nonusers and 
why? v _ 

• What are the users' suggestions for im- 
provements? 

The Council requested a briefing in one year on 
results of a survey conducted to answer th e ir 
questions. That meeting, set for May 1992, would 
provide the Council with needed insights into re- 
quirements that NASA users have for STI prod- 
ucts and services. 

III. How to Determine NASA's Requirements 
for STI? 


An STI Team was formed to implement a 
plan to answer the Council's directives. The Team 
was composed primarily of staff from Headquar- 
ters and two Federally-Funded Research and De- 
velopment Centers — Logistics Management 
Institute and MITRE. Major contributions to the 
STT Team were provided also by Headquarters 
and Center STI Managers and staffs. 

To acquire data for the study, the team 
determined the need for three survey phases: 

• Phase I: Pretest of survey instrument at 
selected sites 

• Phase II: One-on-one surveys con- 
ducted by Center STI staff 

• Phase HI: Mail back questionnaires. 

The team drafted a preliminary survey instru- 
ment in October 1991 and discussed it with STI 
Managers and staff of each Center via teleconfe- 
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ence. For Phase I, a revised version of the survey 
instrument was pretested at three NASA sites — 
Langley, Goddard, and Headquarters. These 
three sites were selected for their proximity to 
Washington, DC and their representativeness of 
all NASA sites. Thirty-three pretest interviews 
were conducted in November 1991. Phase I par- 
ticipants were selected representatively from ma- 
jor NASA functional areas, i.e., research, 
development, test and evaluation, and manage- 
ment/ administration. 

The survey instrument was revised sig- 
nificantly to reflect experience gained during the 
pretest. The revised instrument was presented to 
NASA STI Managers and their staffs during a se- 
cond teleconference on January 7, 1992. After the 
teleconference, final adjustments were made to 
the survey instrument, and it became the founda- 
tion for collecting STI user requirements data. 

The final survey instrument had five sec- 
tions: 


I. 

STI User Background 

n. 

STI Production 

hi. 

Access to STI 

IV. 

Use of Additional STI Program 
Services 

V. 

Opinions Regarding the Overall 
NASA STI Program. 


The first section gathered demographic data 
about each user. These data allowed the team to 
learn about a user's professional disciplines, work 
roles, levels of education, continuing education, 
length of service with NASA, status as a NASA 
employee or contractor, association with a specif- 
ic NASA program or project, previous position 
held, and participation in professional societies 
and other associations. These data allowed an ex- 
amination of the demographic variables asso- 
ciated with frequent and infrequent users when 
undertaking later analysis. 

The second and third sections were de- 
signed to elicit relevant feedback on how NASA 
staff use STI publications assistance capabilities, 
products, and services. The fourth section ex- 
amined use of CASI-generated products and ser- 
vices. The last section gathered free text 
responses to questions regarding overall familiar- 


ty with die STI Program, suggestions for new 
products and services, improvements to existing 
products and services, and willingness to partici- 
pate in a user's group for defining the future 
NASA STI Program. 

The final survey instrument was distrib- 
uted to the STI Managers at Headquarters and at 
each Center. Copies were made and the one-on- 
one interviews (Phase II) begun. This final instru- 
ment was adapted into a self-administered mail 
back questionnaire used in Phase III. Explanatory 
notes were incorporated throughout the ques- 
tions to facilitate self-administration. Graphic re- 
presentations of the title pages of some of the STI 
products were portrayed to heighten recognition 
for individuals who might not be familiar with 
them. 

IV. How the Survey Instruments and Ques- 
tionnaires Were Used 

To address the concerns of the STI Coun- 
cil, a methodology for identifying both frequent 
and infrequent users had to be determined. Fre- 
quent users would be identified by the STI Pro- 
gram located at each NASA Center since staff 
there would be familiar with those individuals 
who routinely requested and used STI products 
and services. Based on data obtained from the 
NASA Headquarters Personnel Office, the total 
population of government scientists and engi- 
neers was given as 10,385. A projected sample 
size needed from each Center, in order to obtain a 
confidence level of 95 percent in the surveyed re- 
sults for frequent users, was determined. The 
number of individuals from each Center for Phase 
II interviews are shown in Table 1 . 

The individuals who were difficult to 
identify were those persons who did not come to 
the library, who were not on the mailing list for 
STI products, or did not have a RECON account. 
A random distribution approach, known as Phase 
in survey administration, was determined to be 
the most effective way to approach infrequent us- 
ers of STI products and services and to learn of 
their requirements. A database for random sam- 
pling across all Centers for identifying infrequent 
users was prepared using machine-readable tele- 
phone books acquired from each Center. Al- 
though this approach also would contact users of 
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the STI Program, there was no other methodology 
available, given the time constraints of the study. 
For obvious reasons, the following groups were 
deleted from the database and did not participate 
in Phase HI: 

• Frequent users identified by the Centers 
for Phase II interviews 

• Participants interviewed by Dr. Thom 
Pinelli in the earlier NASA STI Program user sat- 
isfaction assessment survey 

• Staff from NASA Directorates and Of- 
fices not typically in need of STI, e.g.. Personnel, 
Budget and Finance, and Security 

• STI Program staff at a NASA Center 

• Members of the STI Council. 


NASA Center 

Number Of Re- 
quested Phase II 
Interviews 

Headquarters 

5 

Ames 

45 

Goddard 

70 

Johnson 

50 

JPL 

50 

Kennedy 

45 

Langley 

45 

Lewis 

60 

Marshall 

80 

Stennis 

5 

TOTAL 

455 


Table 1. 

To achieve a high confidence level, the 
team's goal was to have 2,500 completed Phase III 
questionnaires returned. Based on a 30 percent 
rate of return, more than 7,400 NASA employees 
and contractors were randomly selected from this 
database to receive the Phase III questionnaire. 
Each Center was represented proportionally in 
the selected group. In addition, more than 50 for- 
mer users of STI products and services, i.e., indi- 
viduals who had dropped their RECON accounts 
in the last two years, also received a Phase HI 
questionnaire. Table 2 shows the sample size and 
number of Phase HI questionnaires distributed 
percenter. 


V. Survey A dministration 

Phase II involved in-depth one-on-one (or 
small group) interviews conducted by NASA 
Center STI Program staff with individuals who 
were identified as frequent users of STI products 
and services. These interviews were conducted 
from mid-January through early March 1992 at all 
NASA sites. Based on experience gained during 
the pretest, an STI Council User Survey Interview 
Plan and Guide was prepared. This Guide was 
briefed to the Center STI Managers and staff dur- 
ing the January 7, 1992 teleconference, then made 
available to them. The Guide provided back- 
ground on Phase II sampling methodology, esti- 
mates for the interview workload imposed on the 
Center staff, and hints for conducting interviews. 

The concurrent Phase HI activity was a 
mail-back self-administered questionnaire distrib- 
uted randomly to NASA staff and contractors. 
Representative samples were drawn from each 
Center, and the Phase HI questionnaires were dis- 
tributed using the NASA internal pouch mail sys- 
tem. The brochure What is NASA's Best Kept 
Secret? which highlighted the STI Program for in- 
dividuals not familiar with its products and ser- 
vices accompanied each questionnaire. Once 
completed, die questionnaire was returned via 
the p»uch mail system, directly to the STI Pro- 
gram office. 

To further assist both phases of survey 
administration, a voice mail number was estab- 
lished. This STI Council User Survey Response 
Line allowed anyone participating in the study to 
call and leave a message of any length. Calls were 
returned within one work day. 

VI. How t he Large Volume of S urvey Data was 
Handled" 

Features selected for a software package 
that would support data analysis of the STI Coun- 
cil survey were: 

• Relational data model 

• Easy-to-use data entry 

• Easy-to-use query capabilities 

• Support for multiple data types 
(character and numeric) 
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NASA Center 

Sample Size Need- 
ed For High Con- 
fidence Level 

Sample Size For 
Phase HI Ques- 
tionnaire Distri- 
bution 

Headquarters 

14 

42 

Ames 

285 

855 

Goddard 

320 

960 

Johnson 

297 

891 

JPL 

285 

855 

Kennedy 

285 

855 

Langley 

294 

882 

Lewis 

306 

918 

Marshall 

327 

981 

Stennis 

76 

228 

Totals 

2,489 

7,467 


Table 2. 


• Support for creating virtual tables or 
views across files 

• Easy-to-use report generation 

• Import/export capabilities. 

The personal computer (PC)-based database soft- 
ware package FoxPro™ was selected for use in 
creating the Phase III infrequent user sample da- 
tabase and for recording both Phase II and HI 
data. A menu and mouse-driven data entry sys- 
tem was developed which mirrored the Phase II 
and Phase III survey instruments. Data were in- 
put quickly into the FoxPro database so that inter- 
im reviews of survey results could be taken. The 
FoxPro™ feature "queiy-by-example" was 
employed to generate tables and statistical analy- 
ses. 

Another database package, InMagic™, 
was used to record and analyze full-text re- 
sponses to a number of opinion-gathering ques- 
tions. Responses to questions such as "What new 
products or services would you like the STI Pro- 
gram to offer?" were varied, but fell into discern- 
ible patterns. Using InMagic™, text responses 
were coded into response categories. These cate- 
gories were adapted to the FoxPro™ input sys- 
tem. Later, data for such opinion questions could 
be reviewed in comparable response groupings 


using FoxPro™, although the full text was re- 
tained for continued in-context analysis. 

VII. Sur vey Results Pointed to Challenges for 
the NASA STI Program 

Center STI Staff conducted 550 Phase II 
surveys. This figure exceeded the requested num- 
ber. Approximately 650 Phase HI questionnaires 
were received back and entered into the database. 
This number reflected only one-quarter of the 
goal for responses the team wanted to obtain. 
Flowever, as a response rate of almost nine per- 
cent, i.e., 650 responses out of 7,500 distributed 
questionnaires, it was viewed as a normal rate of 
return for such endeavors. The study schedule 
did not permit follow-ups with recipients of the 
Phase HI questionnaires. This step might have in- 
creased the response rate. 

All data received in Phases II and III were 
captured in the database, but not all of these data 
were used to prepare for die STI Council briefing. 
Analysis at that time was limited to data needed 
to prepare for that briefing (see questions posed 
by the Council in Section II). 
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A. Respondents' Backgrounds Based on how often a respondent used STI Publi- 

cations Assistance Services the team was able to 
Each respondent had the opportunity to place him or her in a frequent, moderate, or infre- 


Dominant 

Disciplines 

Aerospace 

Engineering 

(15%) 

Computer 

(8%) 

Electrical En- 
gineering 
(7%) 

Mechanical 

Engineering 

(7%) 


Space Science 
(4%) 

Propul- 

sion/Power 

(4%) 

Data Systems 
(4%) 

Physics (4%) 

Flight Sys- 
tems (3%) 
Measure- 
ment/Instru- 
mentation 
(3%) 

Dominant 
Work Roles 

Technical 

Manager 

(23%) 

Applied Re- 
search (19%) 

Test and 

Evaluation 

(9%) 

Basic Re- 
search (9%) 

Admin. Man- 
ager (7%) 
Design (7%) 

Data Analy- 
sis (6%) 
Other (6%) 

Information 

Professional 

(3%) 


Table 3. 


indicate the one or two disciplines and work roles 
that best characterized his or her work. A sum- 
mary of the dominant ones is provided in Table 3. 
Other STI user demographic data presented to 
the STI Council were: 

• The respondents had an average of 16 
years associated with NASA 

• Approximately two-thirds of respon- 
dents were NASA employees. The remaining one- 
third were NASA contractors 

• Almost 90 percent of the respondents 
worked on a NASA Center (not off-site) 

• The distribution of higher-level educa- 
tion degrees was: ' ~~ 

• BS: 38 percent 

• MS: 32 percent 

• PhD: 23 percent. 

Other data were collected on respondents' partici- 
pation in training and course work, but not incor- 
porated into the Council briefing. 


B. Use of NASA STI Publications Assistance 

Sciyices^ : ' aasJ ' 


In order to reflect the STI Council’s direc- 
tive to understand the needs of frequent and in- 
frequent users, the STI Team examined the 
frequency of use of STI services or products. 


quent user category. Two areas of interest rele- 
vant to this question were the disciplines these 
three groups represented, and their suggestions 
for improving the service. Table 4 provides these 
data in order of descending frequency of re- 
sponse. 

Three major reasons that respondents 
gave for not using NASA ST I Publication s Assis- 
tance Services were: they did not publish in the 
course of their work (55 percent), did. not know 
this service was available (19 percent), or they 
used desktop or other in-house publishing capa- 
bilities (9 percent). Tor those users who did use 
this service, the majority were usually Very satis- 
fied with the timeliness, ease of use, and results. 

C Use of NASA STI Resources 

This section of the survey instrument de- 
termined how users located a nd obta ined STI. 
One way was to ask someone^ another was to 
consult published materials, and a third was to 
retrieve information from electronic resources. 

People 

All user types ran ked their co workers as 
the primary "people" resource they tu rne d to 
when locating STI. This is understa ndable s ince 
colleagues tend to be working in similar or re- 







lated endeavors and can give immediate ideas them in a database or distribute them on CD- 
and guidance. For both moderate and infrequent ROM. Others suggested that their existence be 



Frequent User 

Moderate User 

Infrequent User 

Disaplines 

• Earth Science 

• Flight Systems 

• Materials and Struc- 
tures 

• Aeronautic Engineer- 
ing 

•Physics 

• Other, e.g.. Mathemat- 
ics, Ops Research, Fluid 
Systems 

• Aerospace Engineer- 
ing 

• Materials and Struc- 
tures 

• Aeronautic Engineer- 
ing 

• Other 

•Computer or Informa- 
tion Science 

• Electrical Engineering 

Suggestions for Im- 
proving Service 

• Publicize 

• Faster turnaround 

• Improve customer fo- 
cus 

• Faster turnaround 

• No opinion 

■ Improve quality 

• Upgrade resources 

• Easier access to ser- 
vice 

• Improve customer fo- 
cus 

• Publicize 

• Lower cost 

• No opinion 

• Publicize 

• Upgrade resources 

• Faster turnaround 
•Easier access to service 


Table 4. 


users of the NASA STI Program, the next 
"people" resource was librarians at the Center. 
For frequent users, experts who worked at the 
Center was their next choice. 

Printed Materials 

There was a low use rate for NASA- 
generated STI subscription publications such as 
Scientific and Technical Aerospace Reports (STAR), 
Selected Current Aerospace Notices (SCAN), Interna- 
tional Aerospace Abstracts, and continuing or cus- 
tom bibliographies. These publications tended to 
be used two to four times a year. For those indi- 
viduals who did review them, over one-third in- 
dicated that such publications kept them current 
in their field. For the users, almost 20 percent 
stated that these NASA publications allowed 
them to locate additional reference material. 
When asked why they did not use these publica- 
tions, 40 percent of the respondents said that they 
were unaware that the publications existed. Over 
20 percent indicated that they did not need them, 
and almost 15 percent felt that NASA subscrip- 
tion publications were not useful or relevant To 
improve use of these publications, respondents 
suggested that NASA automate them, i.e., put 


publicized better and subject coverage increased. 

NASA research reports, such as Technical 
Reports, Conference Publications, Technical Pa- 
pers, Technical Memorandums, Reference Publi- 
cations, and Contractor Reports, were used three 
to six times per year. For individuals who used 
this group of printed STI materials, 25 percent in- 
dicated that they provided background source in- 
formation while 17 percent stated that these 
reports provided useful technical data. Equally 
important was how research reports keep users 
current in their fields and provide information on 
related work. When asked why they did not use 
these research publications, infrequent users re- 
sponded that there was no need for them, or the 
materials did not apply to their work. The next 
reason given by infrequent users was that they 
were unaware these research reports were avail- 
able. Almost one-quarter of the users of the re- 
search reports felt they were adequate. Others 
suggested they be made available electronically 
and the overall quality improved. 

Use for STI publications produced out- 
side NASA, e.g., journals, textbooks, hand- 
books/standards, and trade magazines, was high 
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with a range of 12 to 30 uses per year. These ma- 
terials were obtained through a variety of means 
including direct procurement, requests made 
through the Center library, or procured by a ser- 
vices support contractor. 

Electronic Resources 

These resources, which encompass RE- 
CON, ARIN, commercial database resources, In- 
ternet, and local services such as a work group's 
bulletin board system, are being used a couple of 
times each month on average. Of interest to the 
Sit Council was use of RECON. Among frequent, 
moderate, and infrequent users of electronic re- 
sources, all tended to do their RECON searching 
at the Center library either on their own or with a 
librarian's assistance. Even frequent users of elec- 
tronic resources indicated that the reason they 
did not use RECON was that they were unaware 
of it. The moderate and infrequent user groups, in 
additional responses as to why they did not use 
RECON, indicated on overall need for awareness 
and training. There are a number of RECON- 
related questions posed in the survey instrument 
combined with information on use of other elec- 
tronic resources. The data are resident in the Fox- 
Pro™ database, but were not analyzed for the STI 
Council briefing. 

D. Respondents’ Suggestions for NASA STI 
Pro gram Improvements 

There were four text responses as the last 
section of the survey that requested opinions on 
the overall NASA STI Program. The first question 
asked how the respondent found out about the 
STI Program. Over two-thirds indicated they 
found out from library a dvertiseme nts and other 
awareness activities initiated by the Center's li- 
brary staff. Almost one-quarter of the respon- 
dents learned of the STI Program as a result of 
participating in the survey. Approximately 20 
percent had become users of the STI Program af- 
ter learning about it from coworkers or by word- 
of-mouth. Still, another 10 percent were unaware 
of the Program. . 


The following suggestions were provided 
in response to the question "what improvements 
or enhancements to current NASA STI products 


and services would you like to see?" in order of 
importance: 

• Distribute a users guide on the NASA 
STI Program (30 percent) 

• Provide access to various products and 
services from a user's PC (19 percent) 

• Provide user training (7 percent) 

• Work toward a more timely publication 
process (7 percent) 

• The STI Program is fine as it is (5 per- 
cent) 


Next the survey asked what new products or ser- 
vices could be offered by the NASA STI Program. 
These suggestions, in order of importance, were: 

• Increase awareness of the NASA STI 
Program (26 percent) 

• Provide access to various products and 
services from a user's PC (22 percent) 

• Don't have a suggestion (15 percent) 

• Improve the publications and publish- 
ing process (10 percent) 

• Distribute NASA documents on CD- 
ROM (8 percent) 

• The STI Program is fine as it is (3 per- 
cent). 

Finally, a significant number of respondents, over 
250, indicated a willingness to participate in a 
group for defining future NASA STI products 
and services. Many provided useful suggestions 
for how such a group could be organized. 

Vm. Presentation before the STI Council 

On May 6, 1992 a briefing on the survey 
was provided to the STI Council. In addition to 
the data analysis directed toward responding to 
questions and issues raised by the Council the 
year before, several major conclusions were pro- 
vided: 

• Frequent Users of the STI Program 
tend to be in "traditional" NASA research disci- 
plines, i.e., involved in aerospace engineering, ba- 
sic research, or technical management. Frequent 
users typically have been with NASA for a longer 
time and perhaps have had more overall expo- 
sure to the STI Program. 
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• Infrequent or nonusers tend to be in 
management, administration, or "traditional" 
NASA applied disciplines. Their work roles tend 
to be applied research, design, and development, 
rather than basic research. Often these users have 
been with NASA fewer than five years. 

• Most of the potential user market is 
unaware of the Program's products or services, or 
the utility of those products or services to them. 

• Convenience and flexibility of access 
are key in expanding use of both publication as- 
sistance services and STI resources. 

• A regular and continuing dialog with 
user groups is required to understand their access 
priorities and to better meet their needs. 

Finally, the briefing delivered three recommenda- 
tions to the STI Council: 

• Continue and broaden user outreach 
efforts to applied disciplines with particular em- 
phasis on newer NASA staff. 

• Plan improvements to the STI Program 
based on survey data. For example, since staff 
tend to rely on coworkers for identifying and pro- 
viding access to STI, facilitate access to those 
coworkers through STI Program services and re- 
sources. 

• Call upon volunteers who indicated a 
willingness to participate in an STI users' group 
and use them to form focus groups. These groups 
can prioritize suggested improvements and ways 
to achieve their implementation. 

IX. Follow-up Activities and Ong oin g Analysis 

Data collected from the survey are exten- 
sive and revealing. Not all the data was used to 
report to the STI Council. The NASA STI Pro- 
gram has begun an active program to continue to 
analyze and review the data in response to specif- 
ic questions as well as assist in examining con- 
tinuing issues. 

Specific projects have been initiated to ad- 
dress the recommendations made to the STI 
Council. To increase awareness of the STI Pro- 


gram, the User Outreach section has been restruc- 
tured and expanded to include representatives to 
support specific NASA Program Offices. These 
representatives are employing a market approach 
to seek out suppliers of STI in order to obtain the 
documents. They also identify opportunities for 
the Program to support their information needs, 
such as database building efforts, specialized bib- 
liographies, and distribution of electronic media. 
The goal of the User Outreach section is to be pro- 
active with the Program Offices in order to make 
them aware of the products and services available 
to meet their information needs. 

To facilitate access to sources of STI, in- 
cluding peers (an important "people" resource re- 
vealed by the survey), the NASA Access 
Mechanism (NAM) prototype has incorporated 
methods for locating and communicating with 
peers as an integral part of the system design. 
NAM will be fielded for the next six months to 
end users within NASA to obtain feedback on the 
beta version of tire system. 

A user group is being chartered with rep- 
resentatives from the NASA STI community. The 
User Outreach section has contacted the volun- 
teers that were identified in this user survey. Two 
teleconferences have been held to discuss the user 
group. A charter is under development. 

The user survey database is also being 
used by teams who are addressing specific areas 
of development within the STI Program, such as 
acquisitions, to better define user requirements 
and identify potential participants in focus 
groups. 
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